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(57) Abstract 

An interactive television control/operating system for displaying moving pictures from a live television program or a recorded or 
pre-recorded item intended to be displayed on a television. There is described means operable to enlarge a prescribed area of a displayed 
picture. Also described is means for capturing a displayed video image, means for selecting the image to be captured and means for storing 
and/or printing the selected image. Also described is a system for taking a copy of images displayed on a television where said television 
is dispiayiag a live program in which said images are stored in digital memory on a video segment. Also described is a method of selecting 
television programmes for viewing based on selecting TV programs based on what is actually watched. Also described is a means of taking 
audio notes utilising a remote control device operating in conjunction with the television set top box electronics. 
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TITLE; Interactive Television Control /Operating S^^steni. 

DESCRIPTION 

The present invention relates to an interactive television control/operating system. 

Televisions have become increasingly complex over the years and are now merging 
functions normally associated with computers however these functions have not been 
integrated with the TV functionality in a way that makes them easily accessible during program 
viewing and the range functions is also too lixmted. 

Televisions are in widespread use for viewing broadcast program maieriah however 
material transmitted is easily missed such as telephone numbers, weather forecasts and other 
such items. Many television sets are installed in large rooms where they are positioned some 
distance from the viewer making viewing of small details and text difficult, also many viewers 
have impaired vision wliich compounds the situation. 

Over the years the number of television channels has increased significantly, typically 
viewers can select from normal terrestrial channels and cable or satellite transmissions. Many 
viewers find it increasingly difficult to keep track of the programs they wish to view. Many 
attempts have been made to assist viewers by providing electronic program guides (EPG) such 
as Teletext and TV Guide Plus+, whereby a viewer can select future programming based on 
electronically transmitted program information. For systems with tens of channels this process 
can be time consuming especially if setting program schedules for more than one day or for 
programming both TV and VCR scheduling. 
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Television broadcasts are usually periodically interrupted to display commercials, these 
are usually targeted at the viewer based on the program being viewed or related to the time of 
day. These commercials are for the, most pan annoying as they are repetitious and are not 
targeted sufficiently accurately at the viewer. 

Television program and commercial content is diverse which often prompts a viewer to 
remember a thougiit or creates a desire to initiate an action, such as remembenng to service 
their car, buy washing powder, book a particular holiday or remember to ring a friend. It is 
generally not convenient to stop viewmg in order to make a note of these items and most often 
they are forgotten when continuing to view^ 

One aim of the present invention is to provide an operating system for the TV with a 
simple interface that can be extended to add functionality^ to the TV without substantially 
changing the look or feel of the interface or viewing experience. A further aim is to provide a 
range of in-built functions or programs that significantly enhance the vievvdng experience and 
events surrounding it. 

Accordingly, one aspect of the invention provides a television operating system 
comprising a television for displaying moving pictures fi-om a live television program or a 
recordedr pre-recorded item intended to be displayed on a television, and comprising means 
operable to enlarge a prescribed area of a displayed picture, means operable to select whether 
said enlarging means is operable. 

The area to be enlarged may be pre-programmed or preferably selectable by the user. 
More preferably means is provided for selecting the area to be enlarged from within the overall 
area of the television display. The means to select operation of the enlarging means is 
preferably operable remotely usmg a hand held VR controller or the like. The enlarged area 
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may be set at a specific magnification. The magnification factor may be adjustable and may be 
set to a specific magnification by the user, .^tematively the enlargement may be continuously 
variable in the manner of a zoom facility. Preferably such a system would operate simpiy 
enabling rapid zoom in and out functions whereby the viewer can easily discern detail even at a 
distance from the television receiver. Said zoom and pan facihty could also conveniently 
operate on stored snapshot images described further hereinafter. 

Where an analogue tuner is involved means is provided for digitising the signal to more 
conveniently facihtate enlargement. Memoiy^ means is provided for storing the contents of the 
chosen area of the signal to be enlarged as a pixel array of the selected image. The area is 
analysed to facilitate enhancement of the resolution by for example adding white or black 
pixels or coloured pixels to the expanded pixel block which is to be displayed. Accordingly, 
there is further provided image enhancement means. 

Anotlier aspect of the invention provides a television controiyoperating system for use 
with a television displaying images be they moving pictures from a hve television program or a 
recorded or pre-recorded item intended to be displayed on a television or otherwise, and 
comprising means for capturing a displayed video image, means for selecting the image to be 
captured, and means for storing and/or printing the selected image. 

More particularly, the system comprises memory means for storing a plurality of 
selected images as digital representations, means for converting said stored digital 
representations into a signal for displaying on television, and means for selecting from a 
plurahty of stored images the image for display. Preferably selecting the image to be captured 
and /or retrieved is peri^ormed with a remote controller. 



S OOG ID: < O 00 1 0327A 1 , J „ > 



wo 00/10327 PCT/GB98/03140 

4 . 

The above described system malces possible the abiHiy to freeze a video image or take 
snapshot pictures of items of interest such as the weather forecast, adverts, forthcoming 
broadcast trailers, pop groups and subjects related to homework etc. Advantageously, the 
snapshots could be saved to memory or printed on a suitable prmter. thereby enablmg a 
plurality of such items to be saved and retrieved. 

Subtitling or captionmg is also advantageously provided to enable textural or other 
information to be appended to an image prior to printing or committing to memory. Means is 
also provided for reviewing one or more of a plurality of stored images for display on a 
television or for pnming the same. The present invention m.ay be used m combination with our 
earlier videotape indexmg sysiem to provide a convenient low-cost long-term storage of 
images that can be categorised and saved to videotape for later retrieval .Mother aspect of the 
present invention contemplates selectively capturing a piuralit>' of sequential video frames 
and/or audio content of relatively short duration of a program transmission on a digital memory 
means, such as a hard disc or other semi conductor memo^>^ The videotape storage 
capabilities may be used to even greater effect to automatically catalogue, edit and index video 
segments. 

Accordingly, yet another aspect of the invention provides a system provides a system 
for taldng a copy of images displayed on a television where said television may be dispia\dng a 
live television program or recorded or pre-recorded item intended to be displayed on a 
television, m wiiich said images comprising a video segment are recorded on memoir by 
selecting at least a stare point for commencement of recording. 

More particularly a video display sequence is selected for recording to a hard disc 
storage medium or the like, with the user controlling at least a start point and preferably also 
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the end point, where the television is displaying a live television program or a recorded or pre- 
recorded item. The sequence comprises a segment of the displayed contents with a start and 
end points, a remote device controls selecdon of image start and end points, a digital memor>^ 
is used for storing a plurality of video frames corresponding to the segment. A selection 
mechanism described further hereinafter may be utilised for remotely selecting from a pliiralit\^ 
of segments for display. Conveniently an automatic method of categorising the segments into 
groups and archiving the groups onto videotapes or other media is used. Issuing a record 
command instantly causes recorduig of displayed television signal, coding thereof and storage 
thereof Tliis digital storage VCR hybrid is useful for storing and catalogunig numerous short 
video clips such as recipes, sporting moments, pop videos, w^eather forecasts, commercials, 
jokes, announcements or other material that would otherwise be lost due to the complexities of 
operating a VCR and checking for a suitable tape etc. 

The recorded sequence is conveniently referred to as a video segment and is recorded 
primarily for the purpose of subsequently storing on video tape or other mass storage media 
such as DVD for subsequent retrieval and play back. Means is provided to convert the digital 
signal to an analogue TV signal for recording on analogue videotape or other media. Thus a 
plurality of video segments are recorded and are selectable for replay. The subject of each 
video segment is categorised for indexing purposes and/or for storing with other material in tiie 
same categorj^ The categorisations may be determined by the user or automancaily having 
regard to data transmitted with the program. 

An aim of a still further aspect is to provide an improved method of selecting television 
programs for viewing. 
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Accordingly, a still further aspect of the invention provides a method of selecting 
television programs for viewing based on selecting TV programs based on what is usually 
watched, be it for a particular user or- more generally for any users of tlie system, rather than 
using a program hsting m an electronic program guide. Tnis avoids having to scroll through a 
large list of forthcoming TV programs. The system can be used to show what is nomially 
watched on a particular day for a given time thus avoidnig missing a favourite program. The 
system is further adapted to allow a list of possible selections to be displayed in a prioritised 
order according to how often a program is viewed. Viewer groups can be set up or viewer 
names can advantageously be appended to the list. Program trailers are often transmitted for 
forthcommg programs, these can advantageously also be used for adding programs to the Ust 
by pressing the appropriate control button or command sequence. 

The system is further advantageously adapted to inform the viewer of discontinued 
programs and of their replacements or of rescheduling. When switching to a program thai is 
not contained in the view list the user is able to request program details and decide whether to 
view and/or whether to add to the view hst. 

The store of viewmg preferences m^ay be used to provide a list of suggestions for what 
to watch or record on a VCR based on what is usually watched for example at a particular time 
on any day. Viewing preferences can be automahcally assessed by keeping a track of programs 
which have been w^atched, for example over a specific period. Conveniently means is provided 
for marking a broadcast program currently being displayed. Tlie maridng can be used in 
conjunction with the system control means to modifv^ the view^ list, for example to cause items 
to be added or removed or to specify an item not to be added to the list. Means may be 
provided to add items to the view list but in such a way that it is hidden from view at least as 
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far as a main list is concerned. Means may be provided to automatically add an item to the 
view list after viewing the item for a predetermined time. Means may be provided to add an 
item on days/and or times other than the current day or time where the item is part of a series 
transmitted on different days and/or times. Tliis convemently operates by extracting details of 
broadcast times from an electronic program guide or more preferably from data transmitted 
with the program. Means may be provided for automatically warning a viewer that a program 
is about to be added to the view list. A countdown timer or such like may be employed to 
enable a cancel function to be activated by a viewer. 

Preferably on selecting the view list at least one program suggestion will be displayed 
usually identifying the next occasion when a program of a particular category or more usual a 
category usually watched by the viewer, is due to be shown. Different viewers may have their 
own view lists. Program suggestions are preferably ordered according to the frequency of 
viewing. Means may be provided for checking whether a programming suggestion has been 
rescheduled or is still scheduled for transmission. Means may be provided for informing a 
viewer that a program view suggestion has been rescheduled. Means may be provided for 
amending the view list accordingly. 

More preferably means is provided for receiving data transmitted with television 
signals and^or additional data accessed via a modem. The data may include program details in 
text form, the category of the materia! transmitted, along tlie lines used for VBI data 
transmissions, scheduling times and information relating to follow on programs for serials 
and/or multi part programs, which infomiation can be captured and utilised to generate the 
\'iew hsts. 
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Means is preferably provided to extract information relating to a displayed program 
including for example channel program title, start time, end time and category and to display 
same on a television screen and/or to add to said view list. 

It is particularly advantageous if program trailers are accompanied by such data 
transmissions to enable such program to be added to the view list. 

Means are provided for editing the view lists. Conveniently means is provided for 
adding entries to the view hst from an electTonic program guide schedule. 

More conveniently still means is provided to make a selection from the view list which 
selecdons cause the television to switch to that channel immediately or at the designated start 
time for the program selected. 

A still further aspect provides a method of talcing and replaying audio notes. These 
may be recorded by a microphone built into the TV remote control or by a microphone 
incorporated into the TV, set top box or an external microphone. Audio notes can be replayed 
later by pressing the appropriate button or issuing the necessary commands. Alternatively 
audio notes can be appended to the program hst to be played at a specific time. Different 
messages can be recorded and assigned to groups or user names and edited or deleted. The 
audio transmitted with the TV program can be automatically muted during record operations. 

The audio notes of the present invention can also be a copy of the audio content 
transmitted along with program material, such as phone numbers or product information, jokes 
etc. The system is further adapted to run speech recognition software to conven audio notes 
into text that can be viewed, printed or stored. 

More panicuiarly this aspect of the invention provides a system for storing audio notes 
while using a television comprising, means for con\^erting sound into digitised samples, means 
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for sroriiig said digitised samples in a television or television peripheral and means for 
replaying said digitised samples as an audio signal, means for causmg said digitised sample to 
be stored, means for terminating the storage of digitised samples and means for causing said 
digitised samples to be played. 

Preferably the system further comprises means for editing said audio notes, for example 
to truncate, concentrate or delete the recorded items, or assign to a group or name. Preferably 
means is provided to automatically mute the audio output from the television during recording. 

Means is conveniently provided for converting said stored samples to a text equivalent. 
Convemently said means includes a speech recognition function. Means is convemently 
provided for editing the text. Means is conveniently provided for printing tlie text and/or 
transferring the text to another device. 

Yet another aspect of the invention provides means of receiving and displaying 
commercials targeted at a viewer based on a list of preferences created by the viewer. 

These preferred commercials are stored in local memory in digital form and may be 
automatically inserted during commercial breaks replacing the normally transmitted 
commercials. Vv%ile viewmg commercials the viewer can mark a commercial as viewed, 
replay a commercial or indicate whetlier further information is required. If further information 
is selected, a locally stored extended version of the adven can then be viewed or the system can 
go online to connect to an external source of data. Preferred commercials are acquired by the 
system during standby mode, w^hen the TV is not in use the system preferably switches the 
tuner to a channel that is preferably dedicated to the continuous transmission of commercials 
which may cycle every hour or so. Alternatively the system can receive broadcasts during the 
night thus avoiding the need to dedicate a channel to commercials during peak hours. 
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Preferred commercials can either entirely replace conventional commercials or more 
advantageously replace a subset leaving certain general commercials un-replaced. Data 
transmitted along with each commercial in theVBI can serve as a trigger to cause commercial 
substitution, VBI encoded data is decoded by DEC means. Viewers watching a program 
without the present system will see the conventional commercials that appear in the program 
breaks, the system is thus able to operate within the conventional broadcast system yet achieves 
targeted advertising which benefits both the broadcaster and viewer. 

More preferably the system for the display of targeted commercials on a television 
receiver comprises, means for receiving commercials, means for selecting from said 
commercials, and means for displaying selected commercials. 

Preferably means is provided for the user to select which of the commercials are to be 
recx>rded. For this purpose the commercials are categorised. The categories of commercial 
may be correlated with the categories of program that a viewer watches. The selection of the 
commercials for recording and/or displaying may be achieved automatically having regard to 
the categories of program which the viewer watches. Tlie correlation may be dictated by the 
advertiser more preferably the user enters data into an onscreen form for capturing viewer 
preferences using cursor keys to select fi-om options. 

This aspect of the invention applies equally to so called "banner" advertisements which 
are transmitted along with other data for example as part of a text transmission or more 
particularly as pan of an electronic program guide (EPG) transmission. Electronic programme 
guides are transmitted at frequent inter\^als (for example every second or so) for capturing by 
the memor}'^ means of a set top box. Banner advertisements are usually messages, which only 
occupy pan of the area of the television screen and are mtended to be displayed alongside other 
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(usually unrelated) information. At present the ''banner ' advertisement is transmitted for a 
considerable period of time - perhaps m a single instance lasting several hours or multiple 
instances each lasting few minutes. Tne primary purpose of the transmission is to have the 
EPG available for access by the user. 

According to one proposal the "banner'' advertisement is captured in the memory for 
later retrieval More particularly a pluraht>^ of "banner'' advertisements axe stored in memory. 
More particularly still each transmission of the EPG may be accompanied by the transmission 
of a different banner advertisement. By this means it is possible to build up a store of a banner 
advertisements in memory. Preferably whenever the EPG is viewed one of the stored 
advertisements will be retrieved and displayed in any space allocated for the banner 
advertisement. Of course the existing banner advertisements are not specifically targeted at the 
particular viewer. This is remedied according to an aspect of the present invention by 
arranging for the advertisements to be categorised just as mentioned herein in connection with 
full screen commercials. It is preferred that only those commercials in the user selected 
category or categories ai^e captured and stored in memory from the plurahty of different banner 
advertisements which are transmitted. 

The software acts to display banner advertisements from the plurality of stored 
advertisements — say on a sequential basis, where only advertisements of the desired category 
are stored or where all the different advertisements are stored the softv^^are acts to select out 
those of the desired category and display in turn. 

According to another aspect, where a plurality of banner advertisements are transmitted 
en-block, for example, v^dth every periodic transmission of an electronic program guide, the 
banner advertisements are assigned category codes and decode softw^are acts to select directly 
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from the plurality of transmitted banner advertisements and advertisement for display which 
fall into a user selected category. 

rnis does not require the advertisements to be stored. It is applicable to a digital 
system where a plurality of banner advertisements can be readily transmitted along with digital 
pictures of data. Some bandwidth may be lost as a consequence of transmittmg the plurality of 
banner advertisements simultaneously. 

Further optional provisions include the ability to view what may be referred to as an 
extended advertisement. A banner advertisement may be linked to one or more screens of 
advertisement information (text and/or pictures) which are stored m memory and retneved on a 
user command. Optionally the banner advertisements and (or the extended advertisements) 
may include or comprise an animated display portion. 

-Another aspect of the invention proposes a system for recording a digitally transmitted 
television broadcast on an analogue video cassette recorder or other analogue device whilst 
viewing another digital broadcast, the system comprising two digital tuners and at least one 
digital to analogue converter, and wherem one digitally transmitted television signal is decoded 
usmg one of the digital tuners and converted into an analogue signal using the digital to 
analogue converter and relayed to the analogue %'ideo cassette recorder or other such analogue 
device, whilst leaving the other digital tuner available for decoding another digital 
transmission. 

The various aspects of the present invention will now be described fiirther heremafter. 
by way of example only, with reference to the accompanying drawmgs; in wliich: - 
Figure 1 illustrates an image displayed on a television screen; 



SLJEET:TU'T=. SHEET (RULE 2S; 

BNSDOCID- <WO 0010327A1 I. > 



wo 00/10327 PCT/GB98/03140 

13 

Figure 2 illustrates the television screen showing an enlargement of pan of the image 
displayed in Figure 1 ; 

Figure 3 illustrates the image display of Figure 2 showing on-screen menu command 
options; 

Figure 4 illustrates the image display of Figure 2 showing another on-screen command 

option; 

Figures 5, 6 and 7 illustrate altemative configurations of control means for selecting the 
area of interest for enlargement and caption control; 

Figures 8 and 9 illustrate means for controlling the enlargement selection and scale, 
farther image and further caption control options; 

Figures 10 and 11 illustrate further image control options; 

Figure 12 illustrates the display of Figure 2 with added captions; 

Figure 13 illustrates an image displayed on a screen and a selection of consecutive 
video fi"ames and associated audio; 

Figure 14 illustrates a screen displaying a plurality of snapshot images and on screen 
menu and control options according to another aspect of the invention; 

Figure 15 illustrates in block diagram, form signal processing apparatus and pictonal 
representations of a video cassette recorder and a television for implementing one or more 
aspects of the present invention; 

Figure 16 illustrates one embodiment of remote control umt; 

Figure 17 illustrates an altemative embodiment of remote control miit; 

Figure IS illustrates a television screen displaying an example of a viewing list and on- 
screen control command options according to another aspect of the invention; 
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Figure 19 illustrates a television screen displaying an example of audio notes and on- 
screen control command options according to yet another aspect of tlie invention; 

Figure 20 illustrates an image, displayed on a television screen with an ai-ea marked for 
enlargement and accompanying resolution enhancement; 

Figures 21, 22, 23 and 24 are examples of resolution enhancement options; 

Figure 25 is a diagram illustratmg fiirther details of one embodiment of remote control 
handset with audio note facility; 

Figure 26 is a block diagram illustrating further details of a prefeixed arrangement of 
processing circuitr\'; 

Figure 27 is an example of screen display used in connection with the targeting of 
commercials; 

Figure 28 is an example of a screen display illustrating another aspect of the invention 
in relation to the capture and display of banner advertisements, and 

Figure 29 illustrates diagrammatically how a banner advertisement may have extended 
advertisement material associated therewith. 

Figure 30 illustrates a coding system; 

Figure 31 illustrates data representmg categories, and 

Figure 32 illustrates a system utiUsing conventional semi -calculator memory to store 
user preference information. 

A first aspect of the invention concerns the enlargement of an image displayed on a 
television screen. The screen surround is shown at 1 in Figures 1, 2, 3, 4 and 12. An area of 
mterest which is to be displayed to an enlarged size is shown outlined in white at 3 in Figure 1 . 
The image in that area is sho^^'n enlarged to foil screen size in Figures 2, 3, 4 and 12. The 
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degree of enlargement or magnification may be fixed at say 2x magnification, selectably 
programmable by tiie user say in pre-set steps or infinitely variable within upper and lower 
limits. Figure 9 shows two control buttons 7, 9 which may be provided on a controller to 
facilitate switching between the normal image and an enlargement of an area thereof at 2x 
magnification. Figure 8 shows two control buttons 11, 13 which may be provided as a 
controller to facilitate variable enlargement on a continuously variable basis between nomaal 
image size and a set maximum enlargement. 

Figure 5 illustrates one embodiment of control switch 15 for controlling positioning of 
the area of interest. It will be set to default to a central position. The switch permits the user to 
centre a movable cursor or an area of interest box on the area of the image to be enlarged. 
Thus, the box may be moved up, down, to the lefi: or right until the desired position has been 
arrived at. Figure 6 shows an alternative configuration of control switch 16 for effecting the 
same movement as that of Figure 15. Reference 161, 16r, 16u and 16d denote movements to 
the left, right, upward and downward respectively. Figure 17 illustrates a remote control 
handset described further hereinafter but having equivalent control switches 161, 16r, 16u and 
16d. Figure 7 shows a yet further alternative 17 to the control switches of figures 1 5 and 16 for 
effecting the equivalent movements in the form of a joystick control. The control switches of 
figures 5, 6 and 7 have a dual function for controlling cursor positioning for other command 
options as discussed fiuther hereinafter. 

Figure 3 shows on screen menu and command options which fiom left to nglit are 
zoom 18, norm 19, snap 20, back 21, TV 22, VCR 23 and next 24. 

Selection of the listed functions may be by movement of a cursor to higlilight or 
otherwise select the desired option - perhaps most conveniently on a scroll through basis. 
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Some of these available menu options are represented by iceys on the remote control handset of 
figure 1 7 namely an enlarge on/off key 71, a snap key 20 and a menu key 67. 

The zoom command option 18 or the enlarge key 71 changes the display into enlarge 
mode and activates means for positioning an associated area of interest and/br magnification 
controls therefor. The norm command option reverts to the normal picture display and deletes 
any on screen menu command display. The snap 20 and back 21 commands concern switching 
between snap shot images and normal image aspects described further hereinafter. The TV 22 
and VCR 23 control switching between commands for television signals and videocasseite 
recorder command options on the case may be. The Next 24 option brings up any subsidiary- 
menu 24 options. Figure 4 illustrates a simple second on-screen command option simply 
providing an option for selecting say the menu shown in Figure 3, other commands or menus 
can be smiiiarly created and accessed through a main menu or appropriate short cut buttons on 
the remote controller such as 77 and 61 of Figure 17. 

Enlargement of the displayed image may require the resolution of the enlarged image to 
be enhanced. In this regard reference is made to figures 20 through 24. By way of example a 3 
X 3 pixel array from within the area of mterest of the image which is to be enlarged as shown at 
3 1 m figure 20. The expanded version of this array is represented in this example by the block 
shown at 33. The onginal array 31 is analysed for the distribution of black and white pixels 
representing the luminance component only. Thus in the example, the top left hand comer 
pixel 35 is black and all the pixels 35 along the lower edge and riglit hand edge are black, each 
red, green and blue component can be analysed in a sknilar manner with the final pixel value 
being a composite of each. 
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In the expanded biock, pixel 35 remains in the top left hand comer and the other black 
pixels 35 are distributed along the lower and right hand edges. Following from the original 
analysis, the resolution enliancement softw^are acts firstly to produce an expanded frame with 
black in the top left hand comer and along the lower and right hand edge by adding in pixels 37 
as shown in block 39. Tlie resolution enliancement software adds ftorther pixels 38 of a colour 
to tone down white areas where white pixels are perceived to be inappropriate so that the 
resulting expanding image would be as shown at 39 in the case of this example. 

Figure 21 shows four examples of pixel arrangements which are predommantly white 
and how an expanded array has 3 coloured pixels added at 38 surrounding the black pixel 35 to 
produce an expanded array with the same visual impression. Pixels added at 38 are calculated 
according to the difference between neighbouring pixels, in this example the number and value 
white to black and their disposition according to Figures 2 1 to 24 is utilised. Figure 22 shows 
the resolution enhancement for arrays of equal black/white vertical and horizontal pixel 
combinations shown expanded at "a** before resolution enhancement, and at "b'* after resolution 
enhancement. Added black pixels are referenced 37 and added coloured pixels as 38. 

Figure 23 shows equal black and white diagonal pixel combinations expanded but 
before enhancement at "a", and after enhancement at The additional black pixel is 

referenced 37. 

Finally, Figure 24 shows a majority of black pixel combinations with the resolution 
enhancement shown at "b". The same notation apphes as previously. The enlargement 
function is intended to operate predominantly on moving images transmitted as live television 
signals or as replayed from a recorded or pre-recorded video tape or other video storage 
medium. Enlargement requires repositiomng of the image signals (pixels) to take account of 
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the degree of enlargement and addition of the signals for the extra pixels to improve the 
resolution. The enlargement could also be applied to retnevai from memor>' of still video 
images previously captured and stored m memory. 

Reference is now made to another aspect of the invention which concerns the abihty to 
take snap shots of image being transmitted and viewed as a live television transmission to 
facilitate review at a later date. For example it could be useful to have available for future 
reference one or more images of a weather forecast. This is conveniently done by using a 
control command to take a "copy" of the image currently bemg transmitted using the snap 
control shown in figure 3 or 20 of figure 17. By converting the signal into a digital signal 
where not already m that format it can be saved in a digital memoiy such as a hard disc, for 
subsequent retrieval and display on screen - see 87 of Figure 15. The provision of a printer 
port connection - see 86 of Figure 15 permits printing out of selected snapshot images. 
Figures 10 and 11 show varioiis control options associated with the snapshot facility. Button 
10 controls printing of a snapshot. Button 12 is an alternative control for taking a snapshot. 
Button 16 is provided to initiate caption generation. Button 14 facilitates downloading of the 
snapshot to an external disk storage meditxm. 

A senes of frames may be stored which are taken at periodic intervals or as a sequence 
of frames, see 40 in figure 13 which shows four frames, and stored for display as either still 
images or as a moving sequence as tlie case may be. These frames could be subsequently 
recorded onto video cassette tape or other media for longer term archive storage and reference. 
Audio signal may be added as illusfrated at 44 m figure 13. Caption information may be 
added. 
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Referring now to figure 12, this illustrates the enlarged image of figure 2 which has 
been saved as a snap shot image and to which a caption has been added. In liiis instance the 
words Rover cars. Positioning of the caption is controlled by usmg the control switches 16L 
16r, 16u, 16d or equivalent to control movement of a cursor, and appropriate graphics 
generation softw^are to add the desired text either manually or by pulling in text fi-om caption 
data transmitted with the image. Means for generating captions is well laiown in the art and is 
not described further herein. The snap shot image may be the full size frame or an enlarged 
part thereof 

It is a further advantageous feature if the snap shot images are categorised to permit 
storing in an index which is organised into categories, whereby snapshots or video segments 
are automatically appended to a portion of video tape or other media in a position relative to 
similar material previously recorded. The categorisation may be determined by the user or 
extracted from categorisation data or program content data transmitted with the original image. 

The images captured from the television transmission and which are stored in memory 
can be displayed on screen as a plurality of images as shown in figure 14 with options for 
viewing in full size and retrievmg any audio signal stored in memorv^ or retrieving associated 
images wliich have been recorded, say on video tape. In this respect our earlier proposals 
regarding automatic video tape positioning can be utilised and are not described in farther 
detail here. 

The provision for recording video signals is instigated using a remote control device 
such as that illustrated in Figure 17. Key 68 controls ony'off selection of the video segment 
option. Once this function has been selected a command is issued to start recording instantly 
using Key 81. The signal recovered is stored m digital memory - see for example S7 of Figure 
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15. A plurality of video segments are stored in the digital memory. Figure 14 illustrates the 
fonnat tn whrch the contents of the video segments can be displayed on screen as a pluralit>' of 
lead images for each segment. The display option is selected via tl.e \aD key 68 and the Menu 
key 67. The selection of any of the displayed miages is described further heremafter and is 
equally applicable to the snapshot frames referred to above and to the video segments. Tnus 
the screen displays menu options which are selected by movement of a cursor to the desn-ed 
item. Main selects a mam option screen, VCR selects the VCR screen, TV selects a TV guide. 
Forward and Back pemiits the user to see more snapshots on other screens. 

Moving the cursor over any one of the displayed miages plays the sound or video clip 
of that image. Clicking on the picture exchanges to full screen size. The cursor is controlled 
from the remote confrol handset using keys 161, 16r, 16u, 16d. 

The video segment is categorised by extracting data transmitted with the program or for 
an electronic program guide whereby the video segment may be placed m the appropriate 
categoiy of a video tape or other video storage medium for long term reference. Tl.e modem 
port 84/205 facilitates connection to the eiectromc program guide for example via the Internet. 

A yet finther aspect of the invention concerns the creation, display and utilisation of so 
called view lists. More particularly these provide for selecting programs for viewing based on 
what a viewer usually watches, or programs falling into the same category as those he or she 
usually watches, or programs specifically identified for watching. An example of a view list is 
showi. in figure 18. In this example three programs are hsted. Tne mformation provided is a 
brief prograna title, on indication of the typo or category of the program matenal, the time when 
it IS bemg shown, the name of the person who typically views either that specific program or 
that categoiy of program matenal and the frequency with which that category of matenal is 
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viewed. Channel information may be displayed or stored in background memory to facilitate 
selection of the appropriate channel if any of the items is selected for viewing. 

Preferably the displayed information and any related background information is 
retrieved from data transmitted with the program. This also enables the software to interrogate 
an electronic program guide to identify similar categories of material and list them as potential 
viewing options in addition to or as alternative to any usual items which are viewed at any 
particular time or on any day. 

In the preferred embodiment the programming software notes programs which have 
been viewed and adds them to a viewing list where they are serial type programs, and-^or notes 
the categories of programs viewed. The software programming and control options allow a 
user to specify categories to be viewed. 

Figxn-e 1 8 shows the followmg on-screen command menus namely: - Go to 5 1 , Next 
52, Back 53, Day 54, Delete 55, Add 56 and Off 57. The numbers are the references used in 
the figure. Off 57 turn off the menu and view list Go to commands the television to select 
and play the selected programs - say that shown within the boxed outlined at 59. The box may 
be positioned using the aforementioned cursor positioning controls or using the Next 52 and 
Back 53 command options, which option could be scrolled through or again using cursor 
positioning controls. The Day command selects the viewing list for a particular day of the 
week. The Delete option permits a listed program to be deleted from the view list and the Add 
option permits a new^ item to be added to the view list. This may be presented as an option for 
addition to the view list by the softw^are programming selecting appropriate categories of 
program from an electronic programming guide. 

The main function buttons or on screen commands available to the user include: 
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a mark function, which adds the marked item to the view list, be it the current program 
or a trailer for a future program. 

an Ignore function which does not add an item to the view Ust. Usually a displayed 
item would be added after a preset viewing time, 

a hide function which adds an item to a private list and hides from a general viewer. 
Examples of other functions are: - 

New, which informs of new program transmissions 

Today, which list items coming up next etc., based on previous viewing not EPG. 

* Edit, which permits manual change to the view list, e.g. add/remove. 

* Rexnew list for watched programs for any day. 

* Status, item never seen. 

Info, what is tliis? tell me more, i.e. go to EPG for description and start and end times. 
Display poster view? 

Referring to figure 17, the keys for controlling basic view list menu functions are 
shown at 61, 63 and 65. Key 61 selects the view list function resulting m a display such as that 
shown in figure 18. The off key 63 deletes the view hst or menu function, whilst the view key 
permits selection of a displayed item for viewing. Selection is conveniently achieved using the 
cursor keys 1 6 and/or menu items 52, 53. Key 67 is a main menu selection key and facihtates 
access to all menu options to access all functions and setting of all selectable parameters, e.g. 
magnification range for enlargement/zoom feature, and program categorisation. Key 20' 
controls taking of a frame snap shot as discussed m relation to figures 13. 14 and 15. Key 68 
controls the video segment function. 
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Key 71 instigates operation of the enlarge function - say on an on/'off basis. The twelve 
keys at the top of the unit represent traditional television control keys. The I/R transceiver is 
shovm at 73. Also shown is a microphone key at 75 and audio note menu keys 77, 79 and 81 
vvliich are described further hereinafter with reference to figure 19. 

The audio note feature has on/off controi keys 77, 79 respectively for accessing audio 
note controi options as shown in the command menu in the onscreen display of Figure 19. Key 
81 controls an instant record function. Figure 19 shows an example of a list of items which 
have been recorded. The user has the option to play them using the play option 85, delete them 
using the delete option 87, convert the audio to text utilising speech recognition software 
runiung on the CPU of Fig 15 initiated by the viewer initiating command 89, assign a play time 
to a recorded item by activating menu item 91 which is operable to cause the recorded item to 
play at a set time or day to act as an alarm or reminder, edit the contents of the recording or add 
a text description using the edit option 93, scroll through the listed audio notes using the Back 
option 95 or turn of the replay of the audio note recording using the Off connrol option 97. 

Where according to a preferred embodiment, the microphone is located in the remote 
control handset the audio signals are converted into a form suitable for transmission over the 
I/R link to signal processing apparatus of the associated program control system. Means is 
provided in the remote handset to covert tlie sounds into digitalized signals. The signal 
processing apparatus incorporates means for storing the received signals - say on hard disc, 
and means facilitating subsequent retrieval and replay. Figure 25 illustrates an alternative 
embodiment where the audio notes are recorded in the remote control handset and includes the 
provision of an MCU including ADC aiid DAC circuitry to run voice note software and to 
control the I/R functions. A part of the key pad is illustrated diagrammatically at 74 and may 
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include an optional display at 74' to signal that the record function is operable. The I/R control 
IS shown at 73' and a memory for the software and storing audio at 76". A speaker is shown at 
7S'. The handset may include the . provision for relayang the audio notes to the signal 
processmg circuitiy to facilitate on screen display of the audio notes as described above. 

Referring now to figure 15, here there is illustrated a layout of signal processing 
apparanis for implementing the various aspects of the mvention. niustrated by reference VCR 
is a video cassette tape recorder, and by reference TV, a television. Two tuners are illustrated 
at Tl and T2. Preferably both analogue and digital signals can be received and decoded by 
each tuner. A hard disk or other media storage device 87 stores the new lists. Audio. 
Snapshots etc. A central proceedmg unit CPU runs the installed software and the Memor\.- M 
contains VCR characterisation data and view lists, Audio, Snapshots etc retrieved from the 
hard disc or from \adeo tape on the case may be, also the installed software. A clock is show at 
88. Where two tuners are present simultaneous reception of broadcast programs and recording 
of preferred commercials may also be conveniently achieved. 

An ADC or CODEC unit 89 carries out any necessary conversion of signals from 
analogue to digital or vice versa. The encoder unit 91 carries out any coding and decoding of 
information retrieved from or applied to the video tape for use in automatic tape control 
routines as described in our earlier pending patent appHcations and not described in any further 
details herein. The video system 93 displays the various options on the television screen and 
plays video from disk and tape and tuner and enlarged image etc. A microphone is shown at 
75. This may be incorporated in the remote control handset as described earher. The I/R umt 
sends video cassette recorder infra red codes and received handset commands and digitised 
voice samples. The modem port connection 84 facilitates drawing in data from the Internet etc. 
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Figure 16 shows an alternative configuration of remote control handset 99. It has 
conventional TV/VCR button 100 for channel selection, an I/R transceiver 73 and a 
microphone 75. The Audio notes feature is controlled by keys 101, 103 and 105, which 
control commencement of recordal of audio, stop, record or playback of audio, and play back 
of audio respectively. The handset includes a speaker for playing back the audio notes. The 
audio signals are digitalized for transmission over the I/R link to the signal processmg 
apparatus and for storing, in digital memory and the handset converts back to an audio signal in 
the playback mode alternatively they may be stored in memory 76 of Fig 25. 

The remaining keys control the view list options. The view key 107 causes to be 
displayed or screen the view list for the current time. The next key 109 permits selection of the 
next list for example on a scrolling basis. The Back key 1 1 1 permits scrolling through the hsts 
in the reverse direction. The review key 113 displays a list of programs which are usually 
watched in a day. The Edit key 115 permits the displayed list to be edited. The Day key 117 
permits selection of lists for a particular day. The Mark key 119 allows programs displayed as 
possible options for viewing to be marked for addition to the lists. The Skip key 121 marks 
items which are of no interest and the Hide key 12 permits items to be listed but in a hidden 
manner. The New key 125 allows details of new programs to be displayed and reviewed for 
inclusion on tlie view hst. The Info key 127 causes tiie programming software to seek out 
further infomiation about a listed program, for example by interrogating an electronic program 
guide and displaying liie results or displaying video still or sequence images which have been 
captured from the programming guide or from program trailers. The Status key 129 indicates 
whether items have not been seen. 
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A further aspect of the invention concerns means for receiving and displaying what are 
referred to herein as targeted commercials, i.e. commerciais which are based on viewer 
preferences and/or interests. 

Either tuner Tl or T2 of Figure 15 intercepts commercials which are broadcast, and 
stores them m memory 87. The commercials may be broadcast on a separate commercial 
channel or at times when other program matenal is not usually transmitted - for example at 
specified times overnight. Where two tuners are used it is also possible to decode commercials 
when another program is being watched. Preferably data transmitted with the commercials 
mdicates the category of the panicuiar commercial. Advantageously the software selects for 
storage in memory only commercials in the selected category and general categor>' 
commerciais. The software provides the user, via the menu command control 67, with 
categoiy options e.g. motor vehicles, household, holidays, clothing, so that appropriate 
commerciais are stored in memory. Thereafter, when a viewer is watching a program which 
has commercial breaks, the viewer is presented with the option to view the live broadcast 
commercials or to replace with commercials of any of the selected categories, hi a fiirther 
option, the commercial retrieved may be Imked or otherwise correlated to the category of 
program being watched. Thus the software provides an option for say motor veliicle related 
commercials to be retiieved and shown when watching program material related to motor 
vehicles, similarly for hoUday programs etc. 

In the preferred embodiment described with reference to Figure 26, two tuners 200 and 
201 are utilised, both are digital and therefore able to receive extra digital data along with TV 
progi-am content. Such a system aiso is advantageously adapted to allow a video recorder or 
other device to be connected for recordmg digital broadcasts from a channel that is different to 
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the channel currently being viewed, overcoming the limitation of an analogue tuner associated 
with conventional video recorders which cannot be utilised for separately recording digital 
broadcasts. The figure further illustrates two signal demodulators 206, one connected to each 
of tuners 200, 201. These demodulate the received signal and incorporate the necessar}^ 
analogue/digital converters and quadrature amplification demodulators. The signals are passed 
to respective processing units 208 which unpacks the video and data and decompresses video 
signal. These signals then pass to a respective video system 210, In the case of the signal 
processed by Tuner Tl the signal is passed to a television for viewing. Tuner T2 handles 
signals which are to be recorded on a video cassette recorder (VCR), Digital Versatile Disk 
(DVD), or which are downloaded to the Hard disk 203 or other media storage device. An 
encoder 9r is provided to add index information and/or other data to the video signal as 
required to, for example to enable the automatic tape control facility to function as described in 
our earlier proposals. Tne Decode 91' decodes any index and data from the tape being read. 
The CPU 204 runs the installed software. The memory 202 stores VCR Characterisation data, 
as discussed in ottr earlier proposals, and the view lists. Audio Snapshots, softw^are etc. A 
clock is shown at 88. A connection line to a modem port is shown at 205 and a connection to a 
printer port of 207. The microphone is shown at 275 and the infrared transceiver is sho^^al at 
209 and serves to send VCR commands and receive commands from the remote handset which 
may include voice signals, A memory cache is shov^Ti separately at 211 and provides a 
temporary memory to cater for situations w^hen the write and read head of the hard disk is 
moving and to allow for the variable writing and reading rates of the hard disk. Video data 
selectors are shown at 213 and 214, one for each timer selection. These facilitate selection of 
material from the hard disk 203 to go to either TV or VCR, ^^ia the decoding sections, as an 
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altemaiive to the matenal decoded from the respective tuner seieclions. Finally, video selector 
215 permits selection of material from the VCR, D\/D for display on television. 

While operating to receive preferred commercials tuner 200 is devoted to receivmc 
broadcast program material and commercials as normal, while tuner 201 is utilised for 
receiving altemative commercials which are temporanly stored in local memoiy 202. 
Preferred commercials can be received while in standby mode where the TV is not displaymg 
broadcast content using a single tuner, or m the preferred embodiment while the TV is m use 
via tuner 201. Preferred commercials can be acquired by switching tuner 201 to a channel 
dedicated to the transmission of commercials. 

Typically memory 203 would be a hard disk or recordable DVD or the like of 600 
Megabyte or more capacity. Digital broadcasts data rates vary, but 30 ~ 60 Megabytes per 
second is typical of the average data rate, 600 Megabytes therefore would store 10-20 minutes 
of preferred commercials. Typically in a conventional system 40 mmutes of commercials are 
transmitted along with 4 hours of programming, therefore if the preferred commercials replace 
50% of the commercials transmitted they would repeat evew 2-4 hours. 

Under the proposed system convemional commercials are preferably standardised to 
specific iengtlis incrementing m units of say 10 seconds which would facilitate seamless 
commercial substitution, preferably conventional commercials received by tuner 200 would be 
a mix of general commercials and commercials that would be expected to be substituted 
locally. In this way each viewer would still receive general adverts which they may otherwise 
miss and the amount of local storage is reduced. Each advert received by tuner 20O or 201 can 
cany data identifying its coment and category or altemativeiy these could be transmitted as a 
schedule of commercial information as with the likes of program schedules, hi tie preferred 
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embodiment each advert carries data identifying its content, length and other information and 
data indicating if a time slot is active for local substimtions and the length thereof The 
commercials transmitted during a substitution nme slot can also be assessed against a 
preference hst held m memory 202 by CPU 204 to determine if viewing should proceed. 

If a substitution time slot is active and it is appropriate, data stored locally in memor>' 
203 can be assessed for a substitution commercial. At this point the next un-played 
commercials in local memory 203 are selected that will fit m the allocated active substitution 
time slot. This process continues until all commercials have been viewed at which point the 
process can repeat or further commercials received via tuner 201 could replace already viewed 
local preferred commercials. Preferably once a preferred conomercial has been viewed the 
allocated number of times memory allocated is freed for further preferred commercials which 
are received on an ongoing basis. Preferred commercials of the present invention may be 
viewed more than once according to the present invention, indeed it may be desired to organise 
preferred commercials to be sequenced according to viewer or broadcaster preferences. If 
during substitution of a commercial tlie viewer switches channel the commercial can either 
automatically terminate in which case it would be marked for replaying, or the viewer can have 
the option to continue with the commercial. 

Typically several tens of normal digital channels are broadcast, this allows for the 
possibihty of acquiring preferred commercials at a fast rate by switchuig tuner 201 to a channel 
scheduled to transmit a commercial that meets viewer selection criteria. A schedule of 
commercial transmission content, duration, start time and duration received tliroiigh modem 
205 or via tuner 201 is stored in memor>^ 202. When a preferred commercial is transmitted 
tuner 201 is switched by processor 204 to the appropriate charjieL the prefen^ed commercial 
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acquired and stored in local memory 203 for later substitution. In this way prefeired 
commercials can be acquired faster, the need for local storage then may be ftirther reduced 
form 600 Megabytes to say 200 Megabytes. 

Transmitting commercial schedules need not interfere with the flexibility that the 
broadcaster normally enjoys regarding late substitution of broadcast material as each system 
according to the present invention can detect if a broadcast commercial matches the scheduled 
commercial, failing a match the broadcast commercial would not be acquired for substitution. 
Adven schedules can also advantageously be periodically updated and transmitted along with 
the normal digital program content. Preferably the selection criteria for preferred commercials 
is determined by the broadcaster transmitting categories to the viewer ^aa data transmitted 
along with the program content EPG's and other services, the user selects from the categories 
stored in memoiy 202 using menus displayed on the television screen facilitated by video 
circuit 206 and CPU 204, remote control of Figure 17 is utilised with cursor control keys 16 to 
effect selections which are then stored as preferences in memory 202 and may also be 
transmitted to the broadcaster via modem 205. Prefen-ed commercials may also be acquired 
through modem 205. 

Figure 27 illustrates one possible screen layout for selection of commercial preferences. 
The fomiat of the screen is transmitted by the commercial provider. The viewer selects from 
the listed items using the cursor confrols or mouse to click on the options. Clicking on up and 
down arrows 240, 242 facilitates moving up and down the listed items as the case may be. 
Selected items are shown outlmed in tlie example. There may be more than one screen of 
options. Menu command options are shown along the lower edge and mclude Move 220, Next 
222, Back 224, Name 226. Delete 228 and Off 270. 
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Move shows fartlier options, Mark and Back facilitate moving forward or backvv^aid 
through screen displays. The Name options facilitates assigning a name of a viewer for a 
particular commercial preference so that the appropriate commercials are displayed when tliat 
viewer is watchmg the television. The Delete command permits previous preferences to be 
deleted. The Off command deletes this menu option. 

The completed preference hsts may be transmitted back to the broadcaster for example 
for analysing the type of commercials wliich are of interest and/or the characteristics of the 
person who selects to view them. 

The capturing and display of user selected categones of advertisement is also 
appUcable to the ''banner'' commercials transmitted along with the likes of electronic 
programming guides (EPG). The electronic program guides are transmitted at regular inter\^als 
and stored in the memoiy of a set top box, satellite decoder or other system. With existrag 
systems any banner advertisement transmitted along with data is displayed on screen when 
EPG is retrieved. According to the invention the advertisements ai'e categorised so that the 
user can select to receive and have displayed banner advertisements falling into a desired 
category. The user selections may be as previously described with reference to Ml screen 
commercials. This system is particularly apphcable to a digital system. 

Studies have shovm that a viewer accesses an EPG four times per hour and that on 
average a television is viewed 6 hours per day. On tins basis 24 banner adverts would be 
viewed each day, each banner varies in data content but 4Kbyes of data is typical for 
compressed banners of the JPEG type. To store locally a smgle days banners would requrre 
96Kbtyes of system meinor>'\ hi pracuce SOKbyes of memory may be sufficient as each banner 
may be viewed more than once m a random or predetermined sequence keyed to the program 
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being viewed or the cuirent selection m the EPG. Acquired adverts can be stored in non- 
volatile system memory until they are replaced, m this way preferred commercials/adverts are 
available to a viewer as soon as viewing commences. 

According to one embodiment, a plurality of banner advertisements are transmitted en- 
block to be acqun-ed by the memory of the set top box. This may be done when the television 
is in stand by mode. Assummg 1000 advertising categones, and that each banner utihses 4 
Kbytes and that the Data rate into the set top box > 1 Mbyte/sec, then the transfer of all the 
adverts as a block would take 4 seconds, hi an alternative the block size can be reduced and 
transmitted with the EPG. Each time the EPG is transmitted (say every 5 seconds) a plurality- 
of new banners are transmitted m a block of say 5 each time - so that over say a 16 minute 
period 1000 different banner advertisements are transmitted. The different adverts can cycle 
every 12 hours or so. 

According to one embodiment all the transmitted banner advertisements are captured 
and stored m memory. TTie programming software then acts to retrieve and display only those 
advertisements wliich fall into the selected categories, hi another preference embodiment the 
software acts to capture and store only those banner advenisements which fall into the user 
selected categories. 

In yet a fimher alternative the programming software acts to select, for display fonn a 
plurality of transmitted banner commercials, one which fails into a users selected categories. 
This avoids the need to store a plurality of commercials m memoiy. It may operate with either 
of the above described full block size or reduced block size banner transmissions. Ln the 
unlikely event that the reduced block size transmissions did not include an advertisement of a 
desired category, a default advertisement may be displayed coiresponding to the last captured 



SUBSTiTUTE SHEET (RULE 25) 



BNSDOOID: <WO 



0010327A1 I > 



wo 00/10327 PCT/GB98/03140 

banner advertisement wliich would be stored in memor^^ Other message, adverts, special 
offers may also be targeted at selected viewers of the present system. These messages stored m 
memory according to user set-up options including preferences and/or otlier user information 
such as security codes. These messages can then be displayed at the users option, typically at 
the commencement of viewing a message would be displayed to inform the vievv^er that they 
have messages waiting. These messages may be targeted at a group of viewers meeting a 
particular criterion or at an individual household. These additional messages may be 
transmitted during normal viewing or while the system is in standby mode. 

Figure 28 is an example of a t>pical screen display for an EPG and illustrates an 
example of a banner advertisement 280 displayed along the lower edge of the screen 
correspondmg to say 6Kbytes of data. This display may comprise static (see 282) and/or 
arumated (see 284) portions, hi one embodiment on-screen control menu options, accessed say 
via a remote handset or a mouse type control, allows the user to see an extended advertisement. 
This may comprise one or more screens of advert related material. This may be stored m the 
set top box memory or accessed via a data line. A single extended advert may utihse 70 
Kbytes of data. Figure 29 shows in its entu-ety one such extended screen at 290 and others 
(292) may be Imked to it as subsequent pages/screens of extended advert. A user command 
facilitates pulling up of subsequent pages or once selected they may scroll through 
automatically until the user cancels the extended advert command. 

The viewer need not enter user preferences directly into the set top box; they may 
mstead fill out a paper form which is sent to the service provider. The ser\dce provider 
subsequently sends tiie preferences to the set top box via a modem or by broadcasting the data 
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along with user set top box address data such as the lil.e used for updating so-called sman 
cards associated with subscription viewing services. 

In another alternative, the broadcaster, for example using the existing secanty 
provisions of the set top box, directs commercials, be they banners or otherwise, to the user 
according to their user preferences. Tlie matenal transmitted is stored locally for later retneval. 

Storing banner adverts locally in system memory allows the broadcaster to control the 
vievmig of these banners. In such a system the broadcaster can have a high degree of 
confidence that a banner has been seen because the banner could be configured not be replaced 
until such time that it has been viewed. This contrasts with existing systems where the viewer 
may not switch on at the correct time or channel for a panicular advert to be viewed. Banner 
adverts can be transmitted as digital data m the vertical blanking interval for conventional 
analogue television or received via the modem. For digital television transmissions the advert 
data can be embedded into the transmitted data stream. Acquisition of preferred 
commercials/adverts can performed by parsing the received data stream to extract adverts that 
contain identification data correspondmg to the content of the advert/commercial. Studies 
have shown that viewers refer to program guides. 

Data relating to viewing habits and responses to adverts can advantageously be 
automatically generated by a set top box or other system monitormg whereby momtoring of 
viewing trends is performed. A code word can be generated relatmg to viewmg preferences 
and viewing habits, this would provide valuable feedback to the broadcaster. The broadcaster 
could receive code words when the viewer renews subscripiion payments for programs and 
other services. Tlie code word could form part of the customer mfomiation provided to the 
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broadcaster, transmitted verbally, electronically or via the mail service. A smart card 
containing user data and access codes could also be utilised. 

Certain characters of the alphabet may be excluded from the coding to avoid errors 
introduced by the viewer when reproducing the number such as would be the case for example 
with the letter 'O' wliich could be confused with the numeric '0'. 

Preferably the code word is a compressed representation of various information of 
uiterest to the broadcaster which is presented to the viewer in a multi- character alphanumeric 
form displayed on the TV screen. The initial cods word represents preferences entered by the 
user, this need only be sent to the broadcaster when first set-up or subsequently if changed, 
indeed at the outset the program viewing habits and other \aewing details will not have been 
acquired. After the initial code word subsequent code words may contain specific viewer 
responses to programmes and adverts, 

A number of methods can be used to generate the code word. One method is to code 
each preference category such as the number of children in the house and their ages by 
assigning a single bit to signify if a household has children and further bits only if the first bit is 
set. Two further bits can then be used to signify 1, 2, 3 or more children, m this way a variable 
bit length is assigned to each category. 

For the example described 1 or 3 bits are used to code a category dependent on the data 
entered by the viewer. Figure 30 illusti'ates nine such categories coded as variable length 
codes, data words, 1, 3, 4, 5 and 7 are 3 bits long while data words 2, 6, 8 and 9 are single bit 
words. Each of the extra bits assigned to a data words 1, 3, 4, 5 and 7 represent information 
about the respective categon'-, in this example the frequency of viewing different types of TV 
programme is represented. 
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Each of the four possible responses: least frequent, low, medium and high are 
automatically assessed by the set top box every time a programme is viewed. These data 
words are combined witl. a normalising value represemmg the total number times the highest 
category was accessed, hi this way an approximate value for viewmg frequency can be 
determined for each category. 

Figure 31 illustrates data representing 13 categories and the normalising data 
representing the highest frequency data, the combined sequence of data for each of the 
categones is also illustrated as a multi -character alphanumenc word. Preferably each code 
word is grouped mto blocks, 15 characters could grouped into three blocks of five which is 
sufficient to encode 30 categones of programs, adverts or viewing preferences. 

Extra bits of data can also be encoded into the code word to ensure that the code word 
is conveyed without error such as parity bits and viewer specific data such as a serial number. 
In this way the broadcaster can determme if the viewer is providing the correct mfonnation and 
that it is without error. 

Figure 32 ihustrates a system utilising conventional semiconductor memory to store 
user preference information, viewmg trends and targeted advetts of one embodmient of the 
present system. 

Code words of the present invention enable the broadcaster to establish viewing frends 
and product preferences for all of their viewers rather than a sample subset as is the case for 
existing methods. Other information can be encoded in a similar way producing a sequence of 
variable length data words, which are then concatenated and converted to an alphanumenc 
code word. 
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Tuner (T) receives TV broadcasts and data which are passed to the signal demodulators 
and ADC (320). A CPU runs the software and unpacks the data stream into video, EPG and 
adverts. An PMPEG engine decompresses the video. A clock/timer 322 controls the CPU and 
a video system 324 which displays the EPG on the TV screen (not illustrated), and preference 
menu, banner advertisements and TV content as well as performing video encoder fimctions. 
A memory 326 stores the system softw^are and is used as the memory for commercials. An I/R 
328 unit sends VCR IR codes and receives hand set commands. 
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CLAIMS 



1 . A television control/operating system comprising a television for displaying movmg 
pictures from a live television program or a recorded or pre-recorded item intended to be 
displayed on a television, means operable to enlarge an area of the displayed picture, and 
remote means operable to select whether said enlarging means is operable. 

2. A system as claimed in claim 1, where said enlarging means is operable to enlarge 
tiie image by a fixed amount. 

3 . A system as claimed in claims 1 or 2 and fnrther comprising means to select the area 
of the display which is to be enlarged. 

4. A system as claimed in anyone of claims 1, 2 or 3 and further comprising memory 
means storing in digital form the image to be enlarged. 

5. A system as claimed in anyone of claims 1 to 4, ftirther comprising image 
enhancement means. 

6. A television control operatmg system for enlargmg an area of a television display 
constructed and arranged and/or adapted to operate substantially as hereinbefore described 
with reference to the accompanying drawings of figures 1 to 9, 15 and 21 to 24. 

7. A television control/operating system for use with a television displaying unages be 
they movmg picmres from a live television program or a recorded or pre-recorded item 
mtended to be displayed on a television, comprising means for capturmg a displayed video 
Hxiage and storing m memory, means for selectmg said images to be capnired, memory 



SUBSTITUTE SHEET (RULE 25) 

BNSDOCID: <WO _. 00103S7A1 _l > 



wo 00/10327 PCT/GB98/03140 

39 

means for storing a plurality of said images as digital representations and means for 
converting said stored digital representations in to a signal for display on television, and 
means for selecting from said plurality of said images for display. 

8. A system as claimed in claim 7 further comprising a means for connecting said 
system to an external printer for taking printed copies of said stored digital representations. 

9. A system as claimed in claims 7 or 8 further comprising a means for storing said 
digital representations in a removable memory means for transfer of said digital 
representations. 

10. A system as claimed in anyone of claims 7, 8 or 9 funher comprising a means for 
enhancing the picture quality of said stored digital representations. 

11. A system as claimed in anyone of claims 7, 8, 9 or 10 further comprising a means for 
editing said stored digital representations. 

12. A system as claimed in anyone of claims 7 to 11 and further comprismg a means for 
compressing and/or expanding said stored digital representations. 

13. A system for taking a copy of images displayed on a television, said copy comprising 
a segment of the displayed contents with a start and end point where the duration is 
substantially shorter than the original entire (broadcast) program, comprising means for 
selecting at least a start point for commencement of recordkig, memory means for storing a 
piuralit}'^ of images corresponding to said segment whereby said plurality of images are 
stored as digital representations, means for converting said stored digital representation in to 
a signal for display on television, and means for selecting from said plurality of said 
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segments for display . 

14. A system as claimed m ciaim 13 and further comprising a means for categorising said 
segments in to groups and a means for archiving said groups onto vide tape or other storage 
medium in either digital or analogue signal form, 

15. A system as claimed in claim 14 where said means for archiving said groups onto 
video tape further comprises means for automatically controlling a video recorder to enable a 
new segment to be appended to an area of the tape associated with the selected category. 

16. A system as claimed in any one of clarnis 13, 14 or 15 and further comprising a 
means for selectmg segments for display based on a television display including a texmra] 
menu and/or graphical menu and/or visual representation of said segments and a means for 
causing a video recorder to move to the position of the recorded segments and play said 
segments whereby said segments are retrieved and displayed on a television. 

17. A system for selecting television programs for viewmg comprising means for stormg 
viewing preferences, means for using stored viewing preferences to generate a view list 
comprised of program suggestions which includes items based substantially on what is 
usually watched, means for marking a broadcast program currently being displayed, means 
for using said marking to modify said view list. 

18. A system as clauned in claun 17 in which means is provided for automatically 
assessing viewing preferences. 

19. A system as claimed in claim 17 or 18 in which means is provided which uses said 
making to cause the view list to be modified to cause items to be added, and/r removed, 
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and/or to specify an item not to be added to the list, 

20. A system as claimed in claims 17, 18 or 19 in which means is provided to add an 
item to the list or a subiist in a hidden or coded form. 

21. A system as claimed in anyone of claims 17 to 20 and comprising means lo 
automatically add an item to the view list after viewing the item for a predetermined time. 

22. A system as claimed in anyone of claims 17 to 21 comprising adding an item on days 
and/ or times other than the current day or time where the item is part of a series transmitted 
on different days and/or times. 

23. A system as claimed in anyone of claims 17 to 22 comprising means to automatically 
warn that a program is about to be added with a countdown timer enabluig a cancel function 
to be activated by the viewer. 

24. A system as claimed in anyone of claims 17 to 23 where said view list contams 
additional information for one or more entries, said additional information can include more 
than one program suggestion and/or viewer name and/or other data, 

25. A system as claimed in claim 24 where additional program suggestions are ordered 
according to the frequency of viewing. 

26. A system as claimed in anyone claims 17 to 25 further comprising a means for 
checking if a program suggestion has been rescheduled, or means for informmig the viewer 
of rescheduling, or means for amending the view list or any combination thereof. 

27. A system as claimed in anyone of claims 17 to 26 farther comprising a means for 
checking if a program suggestion is still scheduled for transmission, and means for amendint^ 
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the view list. 

28. A system as claimed in anyone of claims 17 to 27 further comprising a means for 
ciiscking if a new program is being scheduled for transmission and means for amending the 
view list to include said new program. 

29. A system as claimed m anyone of claims 17 to 28 further comprising a means for 
receiving additional data transmitted with TV signals and/or additional data accessed via a 
modem, or means for extractmg information related to a program trailer, or means for 
accepting input commands from a viewer and means for amending the view list to include 
information related to the program trailer, or any combination of said means. 

30. A system as claimed in anyone of claims 17 to 29 further comprising a means for 
addmg different viewer groups enabling the creation of multiple view lists and means for 
password protecting said view lists. 

31. A system as claimed in anyone of claims 17 to 30 further comprising means for 
editing said view lists, 

32. A system as clauned in anyone of claims 17 to 31 further comprising a means for 
adding entries to said view list from an electronic program guide schedule. 

33. A system as claimed in anyone of clarnis 17 to 32 further comprising, input means 
operable to extract infonnation related to displayed program including channel and/or 
program title and/or start time and/or end tmie and/or other mformation, means for 
displaying the same on a TV screen. 

34. A system as claimed in anyone of claims 17 to 33 further comprising, input means 
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operable to malce a selection from the view iist whereby said selection causes the TV to 
switch to that channel immediately and/or at the designated time. 

35. A system for storing audio notes while usmg a television comprising, means for 
convertmg sound into digitised samples, means for storing said digitised samples in a 
television or television peripheral and means for repiaymg said digitized samples as an audio 
signal, means for causmg said digitized sample to be stored, means for terminating the 
storage of digitized samples and means for causing said digitized samples to be played. 

36. A system as clahned in claim 35 further comprismg a means for editing said audio 
notes whereby, recorded items can be truncated and/or concentrated and/or deleted and/or 
assigned to a group or name. 

37. A system as clahned in claims 35 or 36 further comprising means to automatically 
mute the audio of the TV during recording. 

38. A system as clahned in claims 35 or 36 further comprising a means for recording the 
audio broadcast transmitted along with a TV program. 

39- A system as clahned in anyone of claims 35 to 38 further comprising a means for 
convertmg said stored samples into a text equivalent, whereby said means for converting said 
stored samples includes a speech recognition function. 

40. A system as clahned m anyone of claims 25 to 39 farther comprising a means editing 
said text equivalent and means for displaying said text equivalent on a TV screen, 

41. A system as claimed in anyone of clahns 35 to 40 further comprising a means of 
printing and/or transferring said text to another device. 
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42. A system for the display of targeted commercials on a television receiver comprising, 
means for receiving commercials, means for selectmg from said commercials, means for 
displaying selected commercials . 

43. A system as claimed in claim 42 and further comprising means for accepting input 
commands or data from a viewer. 

44. A system as claimed in anyone of claims 42 or 43 whereby said means for receiving 
commercials operates while the television display is not in use. 

45. A system as claimed in anyone claims 42 to 44 further comprising a means for 
automatically replacing broadcast commercials with commercials stored locally in a memory 
means. 

46. A system as claimed in anyone of claims 42 to 45 further comprising a means for 
enabling a user to indicate a response to an advert whilst it is being viewed. 

47. A system as claimed in anyone of claims 42 to 46 in which the commercials are 
banner advenisements. 

48. A system as claimed in anyone of claims 42 to 46 in which the commercials are other 
messages, advens, special offers are selectively displayed by the user electing to view each 
item 

49. A system as claimed m anyone of claims 42 to 48 in which the receipt Of messages 
and/or adverts and/or special offers and/or other data prompts a message to be displayed and 
or an audible sound to be heard 

50. A system as claimed in anyone of claims 42 to 49 in which the means for selecting 
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from said commercials utilises customer specific data sent by the broadcaster 

51. A system as claimed in anyone of claims 42 to 50 in which the means for storing a 
piuralit}^ of commercials is used to ensure that a commercial is seen 

52. A system as claimed in anyone of claims 42 to 51 in which the means for displaying 
selected commercials uses user preferences 

53 . A system as claimed in anyone of claims 42 to 52 in which the means for displaying 
selected commercials uses user preferences and current selections m the electronic program 
guide 

54. A system as claimed in anyone of claims 42 to 52 in which the means for display mg 
selected commercials uses user preferences and the television programme currently being 
viewed 

55. A system as claimed in anyone of claims 42 to 43 in which the means for displaying 
selected commercials uses user preferences and the time of day and selections made in the 
electronic programme guide 

56. A system as claimed m anyone of claims 42 to 55 in which system monitors viewers 
responses to commercials and/or viewing habits and a means for generating a representative 
statistical code word 

57. A system as claimed in anyone of claims 42 to 56 in which the data used by die 
means for selecting from said commercials is also coded into a representative code word 

58. A system as clahned in claim 42 to 57 m which the representative code word is 
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selectively displayed on the TV screen 

59. A system as claimed in claim 47 in which the banner advertisements are digitally 
transmitted. 



60. A system as claimed m claims 47 or any of claims 48 to 59 when appendant on claim 
47 in which a plurality of banner advertisements are transmitted en-block and means is 
provided to retrieve and display a banner advertisement which falls into a user selected 
categor}' . 

61 A system as claimed in claims 47 or any of clamis 48 to 60 when appendant on claim 
47 in which said plurality of transmitted banner advertisements are stored in memory and 
said means selects an advertisement for display from the stored advertisements. 

62 A system as claimed in claim 61 in which any banner advertisements fallmg into a 
user selected category are stored in memory. 

63. A system as clahned in claim anyone of claims 42 to 62 and farther comprising 
means storing a plurality of commercials as digital representations, means for eonvertmg 
said digital representations into a television signal or data and means for displaying said 
commercials. 

64. A system as claimed m anyone of claims 42 to 63 further comprismg a means for 
selecting an extended version of a commercial and/or means for connectmg to a further 
source of information or data. 

65. A system for talcing a copy of an image displayed on television as claimed in anyone 
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of claims 2 to 16 when constructed and arranged and/or adapted to operate substantially as 
hereinbefore described with referencer to and/or as illustrated in the accompanying drawings 
of figures 13, 14 or 15. 

66, A system for selecting television programs for view^ing using a view list as claimed in 
anyone of claims 12 to 34 when constructed and arranged and/or adapted to operate 
substantially as hereinbefore described with reference to and/or as illustrated in the 
accompanying drawings of figures 15, 16, 17 or 18. 

67, A system for storing audio notes while using a television as claimed in anyone of 
claims 35 to 41 when coristracted and arranged and/or adapted to operated substantially as 
hereinbefore described with reference to and/or as illustrated in the accompanying drawings 
of figures 15, 16, 17 or 19. 

68. A system for the display of targeted commercials or a television receiver as claimed 
in anyone of claims 42 to 64 when constructed and arranged and/or adapted to operate 
substantially as hereinbefore described. 

69. A system for recording a digitally transmitted television broadcast on an analogue 
video cassette recorder or other analogtie device whilst view^ing another digital broadcast, the 
system comprising two digital tuners and at least one digital to analogue converter, and 
wherein one digitally transmitted television signal is decoded using one of the digital tuners 
and converted into an analogue signal using the digital to analogue converter and relayed to 
analogue video cassette recorder or other such analogue device, whilst leaving the other 
digital tuner available for decoding another digital transmission. 
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